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AUTOMATED AND ADAPTIVE MANAGEMENT OF BANDWIDTH CAPACITY IN 
TELECOMMUNICATIONS NETWORKS 

FIELD OF THE INVENTION 

The present invention relates to telecommunications networks and, in particular, 
5 automated and adaptive management of bandwidth capacity in such networks. 

BACKGROUND OF THE INVENTION 

Network planning may be described as the optimized selection of alternative paths 

tfj through a given network to meet estimates of traffic demand on the network and other 

^ operational constraints such as delay and reliability. Reliable traffic demand estimation is 

? fjO therefore a critical step in the network planning process. In telephone networks that cater to a 

Ly single dominant traffic type, namely voice, the traditional process of off-line traffic 

'J' forecasting, where a forecast is fed into an off-line network planning process, has proven to 

j" 1 } be effective. Such an approach to traffic demand estimation uses well established voice traffic 

H models to predict traffic demand within acceptable accuracy limits. The growth rate of traffic 

?E5 demand in telephone networks has traditionally allowed a cycle of network measurement, 

O analysis, forecasting, network planning and deployment to occur over weeks, even months. 

With the explosive growth of Internet traffic, the use of Internet protocol (IP) 
networks for real-time services (Voice over IP, video conferencing) and mission-critical 
applications and the emergence of e-commerce, data traffic volume has surpassed voice 

20 traffic volume and is expected to grow at a much higher rate. Network operators have shifted 
their planning focus to data-centric network infrastructures that can support a wide range of 
applications, including voice, scale well with the growth of data traffic and adapt quickly to 
new market needs. The networks resulting from this shift in planning focus are, at the same 
time, required to be dependable. That is, the resulting networks preferably provide 

25 performance, availability and security equivalent to telephone networks. In such a volatile 
environment, one of the key challenges to network planners is specification, with sufficient 
confidence, of the characteristics, demand and rate of growth of data traffic. The data traffic 
may arise from a wide range of known applications as well as data traffic arising from novel 
applications. Unfortunately, this specification is required in an environment with little or no 

30 historical data. Further, business requirements for these new networks include minimization 
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of time to market, network capacity growth faster than growth of customer base and rapid 
accommodation of factors unknown during pre-deployment planning. 

Typical networks comprises nodes and links between the nodes. Further, connections 
exist from so-called edge nodes within the network of interest to networks external to the 
5 network of interest. Often, a network will be called upon to provide a path from one edge 
node to another edge node, to connect two external networks. Such a path may be set up at an 
edge node, responsive to a request for service from a node in an external network, and 
comprise at least one link between nodes in the network of interest. The request for service 
3 may include a requirement for a certain Quality of Service (QoS) relating to path 
3 0 characteristics like bandwidth and delay. At the edge node, once a path which satisfies the 
^ request is determined, capacity may be reserved in links along that path. A tunnel, as used 
y herein, refers to an edge-to-edge logical path with capacity, reserved on each link in the path, 
J1 sufficient to provide QoS guarantees. 

3 Existing networking technologies involve such functions as tunnel signaling, path 

J 5 selection and admission control. Network nodes use tunnel signaling to establish tunnels, 
C reserve capacity for runnels, modify reserved capacity or tear tunnels down. Known network 
3 architectures include such examples of tunnels as Virtual Paths in Asynchronous Transfer 
Mode (ATM), Label Switched Paths in Multi-Protocol Label Switching (MPLS) and optical 
paths in Wavelength Division Multiplexing (WDM). Examples of Tunnel Signaling include 
20 Constrained Routing Label Distribution Protocol (CRLDP) and Resource Reservation 
Signaling Protocol (RSVP). 

Paths for tunnels can be selected with or without human intervention. A network 
operator may select a path for a tunnel or, given appropriate path selection intelligence, a path 
for a tunnel may be selected by an edge node or a network management node. The capability 

25 of a network to select paths for its tunnels is fundamental to automated network capacity 
management. Such a path selection capability in known networks is exemplified by the 
Private Network-Network Interface (PNNI) standard in use in ATM networks or the Open 
Shortest Path First (OSPF) standard in use in IP networks. Using either PNNI or OSPF, a 
network node may generate a routing table, comprising a list of paths to each other node in 

30 the network, that can be used to select paths for tunnels. Path selection however, is not 

necessarily limited to those routing tables. It is possible to use the information obtained via 



1 > 1998rous01u 



3 



OSPF, with regard to network capacity and its utilization, to select paths different than those 
in the routing tables. 

Once a tunnel is created, it may be used by a number of connections. Subsequent to a 
request for a connection through a network being directed to an appropriate tunnel, the 
5 connection is typically examined by Admission Control (AC), which allows only as much 
traffic as the tunnel can accommodate within its capacity. The AC rejects a connection if the 
connection would increase the traffic carried by a tunnel beyond the tunnel capacity. AC is 
currently implemented in ATM networks as Call Admission Control (CAC), but it can be 
O adapted to other types of tunnels. 

ylO Work on an adaptive and automated capacity management has so far concentrated on 

^ capacity adjustment for virtual paths, resulting in a number of approaches (see H. Saito, 
W "Dynamic Resource Allocation in ATM Networks", IEEE Communications Magazine, May 
s 1997 and A. S. Maunder, P. S. Min, "Dynamic Bandwidth Allocation to Virtual Paths", 

!H International Conference on Performance, Computing and Communication - IPCCC '98), 
Ml 5 which use CAC to monitor traffic carried by virtual paths and modify their capacity if it is not 

adequate. They differ from each other by the assumptions made about the traffic, the traffic 
'-^ models used, the estimators of capacity needs of the traffic and the triggers for modifying 

virtual path capacity. A further proposal, described in S. Shioda, H. Toyoizumi, H. Yokoi, 

"Self-Sizing Network: A New Network Concept Based on Autonomous VP Bandwidth 
20 Adjustment", International Tele-traffic Congress ITC 15, Washington, D.C., 1997, includes 

the calls rejected by the CAC into an estimated capacity requirement for each virtual path. 

These approaches are, unfortunately, limited to ATM networks. 

A different approach is taken in M. Chatzaki, S. Sartzetakis, N. Papadakis, C. 
Courcoubetis, "Resource Allocation in Multi-service MPLS", 7 th International Workshop on 

25 QoS, London, England, 1999. The authors describe a solution for an automated management 
of capacity in MPLS networks wherein the capacity of each link in the network is divided 
between different classes of service. By doing this, a virtual network is created for each class 
of service. Each virtual network has its own routing, which is independent of the routing in 
the other virtual networks. The routing directs new calls to the least utilized routes. When a 

30 virtual link, i.e. a part of a link assigned to a particular class of service, becomes congested, it 
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is given more capacity at the expense of the other virtual links. This approach is also limited 
to a specific type of network, namely Multi-service MPLS. 

Consequently, a need exists for a adaptive and automated capacity management 
approach applicable to a broad range of network types. Further, the approach should address 
5 the dual traffic management problems facing network operators. First, that the revenues of 
installed network capacity are to be maximized while meeting the QoS needs of 
unpredictable traffic and second, that the network capacity is to be increased with minimum 
time and overhead costs. 

SUMMARY OF THE INVENTION 

10 In the present invention, tunnel-based network architectures are exploited for use in 

high-capacity networks. A system and a set of algorithms allow changes in tunnel capacity or 
tunnel paths to adapt to new traffic demands estimated via network measurements. The 
system includes such elements as a tunnel signaler, an admission controller, a path selector 
and a capacity manager. Advantageously, the set of algorithms are applicable to a broad 

15 range of network types. Further advantages of the present invention include its dynamism. 
That is, the system acts in a near-real time mode, based on measurements and information 
exchange within and between network nodes. Additionally, although the capacity manager 
and the path selector make decisions locally, the decisions are based on the network-wide 
information and they have network-wide consequences, i.e. tunnels selected, or modified by 

20 the decisions change bandwidth allocation in the network links. As well, the system may be 
applied at all levels of a network, allowing for a very fast and efficient bandwidth 
management, as compared to individual and independent bandwidth management at each 
level. 

In accordance with an aspect of the present invention there is provided a method for 
25 changing a reserved capacity for a given tunnel, including receiving an indication of traffic 
demand for a tunnel through a network and, based on the received indication, determining an 
estimated total capacity requirement. The method further includes comparing the estimated 
total capacity requirement to the reserved capacity and, where the estimated total capacity 
requirement exceeds the reserved capacity, requesting an increase of the reserved capacity. In 
30 another aspect of the invention a system for automated adjustment of a reserved capacity for 
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a tunnel through a network including a tunnel signaler, an admission controller, a path 
selector and a capacity manager for performing this method. In a further aspect of the present 
invention, there is provided a software medium that permits a general purpose computer to 
carry out this method. 

5 In accordance with a further aspect of the present invention there is provided a 

method of selecting a path from a source node to a destination node including labeling the 
source node and assigning a value to a reported bandwidth associated with each of a plurality 
of unlabeled nodes where, if an unlabeled node has a link from the source node, the reported 
q bandwidth is assigned a value based on a bandwidth of the link from the source node, 
ii~Jl 0 otherwise the reported bandwidth is assigned a value of zero. The method further includes, 
M until the destination node is labeled, selecting a next node, among the plurality of unlabeled 
?! i nodes, having a maximum reported bandwidth value, labeling the next node, processing 
j^l nodes connected to the next node to reassign corresponding reported bandwidth values and, 
s where the next node is the destination node, selecting a path from the source node to the 

Cjl 5 destination node corresponding to the maximum reported bandwidth value associated with 
" ?: t the next node. 

□ In accordance with another aspect of the present invention there is provided a data 

structure for use in communicating information regarding traffic demand for a tunnel 
including an indication of tunnel capacity in use and an indication of total capacity refused 
20 admission to the tunnel. Other aspects and features of the present invention will become 
apparent to those ordinarily skilled in the art upon review of the following description of 
specific embodiments of the invention in conjunction with the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In the figures which illustrate example embodiments of this invention: 

25 FIG. 1 illustrates a schematic network of nodes representing a communications 

network; 

FIG. 2 illustrates elements of a single node in the network of FIG. 1 in accordance 
with an embodiment of the present invention; 
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FIG. 3 illustrates an exemplary hierarchy of network layers indicating correspondence 
between links and tunnels; 

FIG. 4 illustrates steps of an adaptive capacity management method in accordance 
with an embodiment of the present invention; 

5 FIG. 5 illustrates steps of a reserved capacity increasing method in accordance with an 

embodiment of the present invention; 

FIG. 6 illustrates steps of a capacity negotiation method in accordance with an 
embodiment of the present invention; 

FIG. 7 illustrates a path selection method in accordance with an embodiment of the 
10 present invention; and 

FIG. 8 illustrates a parameters processing method used in the method of FIG. 7 in 
accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

FIG. 1 illustrates a network 100, suitable for use with the present invention, 
15 comprising a plurality of nodes 102 and network links 104 between the nodes 102. Particular 
ones 102A, 102B, 102C of the nodes 102 serve as "edge nodes" connecting to nodes 106, 
108, 110, 112 in external (or higher layer) networks over connections 114. Other ones 102D, 
102E, 102F of the nodes 102 serve as "core nodes" connecting only to nodes 102 within 
network 100. Node 102A is shown to include a memory 118 and a processor 116 loaded with 
20 capacity management software for executing methods exemplary of the present invention 

from software medium 120. Software medium 120 may be a disk, a tape, a chip or a random 
access memory containing a file downloaded from a remote source. 

Components of a system 202 as part of an exemplary edge node 102 are illustrated in 
FIG. 2, where the system 202 is used for automated adjustment of a reserved capacity in a 
25 tunnel. An admission controller 204 receives, over the connection 114, requests for service 
from nodes in external networks (not shown) and communicates with a capacity manager 
206. The capacity manager 206 maintains communication with both a path selector 208 and a 
tunnel signaler 210. Both the path selector 208 and the tunnel signaler 210 may exchange 
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information with other nodes (not shown) within the network 100, over the network link 104. 
A tunnel 214 is schematically shown as occupying a portion of the available capacity of the 
network link 104. Once the tunnel 214 is set up over a path, data may flow over that path as 
directed by the admission controller 204. 

5 The notion of network layers is illustrated in FIG. 3. A high layer 310 is illustrated as 

being higher than a middle layer 320 which, in turn, is higher than a low layer 330. In 
particular, each link in a tunnel (represented by the heavier lines) through a network 312 in 
the high layer 310 may be seen to comprise a corresponding tunnel through a network (322 
and 324) in the middle layer 320. Similarly, each link in a tunnel (represented by the heavier 
1 0 lines) through a network 322 in the middle layer 320 may be seen to comprise a 
corresponding tunnel through a network (332 and 334) in the low layer 330. 

In overview, management of the capacity of the network 100 may be automated such 
that the network 100 is adaptive to the stochastic nature of incoming traffic. An edge node 
includes four main elements. Three of the elements, namely tunnel signaling, admission 

1 5 control and path selection, are derived from known technologies, generalized from their 

particular technologies and enhanced as hereinafter discussed. With the addition of a fourth 
element, called capacity management, the four elements cooperate to accommodate the 
capacity needs of the traffic incoming to the network at the edge node. This accommodation 
is performed by estimating the traffic demand and dynamically adapting tunnels to the traffic 

20 demand. 

Tunnels are set up to serve requests for service, e.g. requests for communication 
between edge nodes. Depending on the network architecture, requests for service can be 
requests for Virtual Circuits, calls, sessions or requests for reservation of a specific amount of 
capacity. A network administrator may decide that all requests for service from a first given 
25 node to a second given node should be served by a single tunnel, or the network administrator 
can define different classes of service and require that requests for service of differing classes 
be served by separate tunnels. 



30 



Turning to FIG. 2, the admission controller 204 monitors the amount of traffic carried 
by each tunnel and the capacity required by new requests for service. The information 
gathered from this monitoring is used to determine whether to admit new requests for service. 
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Where known CAC methods either admit or reject new requests, the admission controller 204 
can admit or reject new requests and also negotiate an admission. If available capacity on the 
current tunnel is insufficient to accommodate a connection request, the admission controller 
204 sends an indication of the available capacity to the originator of the request. The 
5 originator may then decide to lower the capacity requirement of the request, abandon the 
request or delay the request to a later time. 

The admission controller 204 periodically passes tunnel-specific information to the 
capacity manager 206 including an indication of the tunnel capacity in use by serviced 
requests and an indication of total capacity not admitted to the tunnel. The capacity manager 
10 206 uses the tunnel-specific information to determine whether the tunnels have adequate 
reserved capacity. 

The capacity in use by serviced requests may be determined by the admission 
controller 204 either from the individual requirements specified by the serviced requests, or 
from measurements of the volume of traffic corresponding to particular serviced requests. 

1 5 Any admission control method that monitors traffic of serviced requests and obtains, or 
estimates, capacity requirements of requests for service can be used. A number of Call 
Admission Controls, which provide such functions have been proposed for ATM. For 
example, methods described in S. Floyd, "Comments on Measurement-based Admission 
Control for Controlled-Load Services", Lawrence Berkeley National Laboratory, July 1996 

20 and S. Jamin, S. J. Shenker, P. B. Danzig, "Comparison of Measurement-Based Control 
Algorithms for Controlled-Load Service", Proc. of IEEE Infocom '97 (both publications 
hereby incorporated herein by reference) are valid choices. 

In some types of traffic, requests for service do not specify capacity requirement. An 
example is the Unspecified Bandwidth Requirement (UBR) class in ATM. For those traffic 

25 types, the admission controller 204 does not make admission decisions for new requests for 
service and every session request is admitted. This is done for two reasons. First, if the 
bandwidth requirement of a session is not known, the admission controller 204 cannot decide 
whether the tunnel can carry the traffic generated by the session. Second, such sessions 
belong to a class of traffic which does not receive any guarantees on the quality of service 

30 and, therefore, can be packed to a tunnel that is highly utilized. The sessions may suffer long 
delays and/or high packet losses, but the data carried in such sessions are typically not 
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sensitive to such quality of service degradation. For those types of traffic, the admission 
controller 204 may estimate only the capacity required by the carried traffic but not the 
rejected capacity requirements. 

The path selector 208 has access to information about the topology of the network 
100 on the capacity of each network link 104, and on the amount of capacity on each4ink- 
networkl04 reserved by the tunnels that use each network link 104. One known method by 
which the path selector 208 obtains this information, used in MPLS networking, is called 
Link State Advertisements. The path selector 208 uses the information from the network 100 
and the information passed by the capacity manager 206 to select a path from a source node 
to a destination node (as described hereafter, such a path may be used to create a tunnel 
between these nodes). There are a number of possible methods that the path selector 208 may 
use to select a path. However, whichever path selection method is chosen, the chosen path 
selection method must be capable of finding a path with at least a specified capacity. 

If the path selector 208 finds a path, which has enough available capacity on each link 
to accommodate an estimated total capacity requirement for a given tunnel, the path selector 
208 sends a description of that path to the capacity manager 206. If there is no path that has 
enough available capacity, the path selector 208 finds the path with the maximum available 
capacity, and passes a description of the maximum capacity path to the capacity manager 206 
along with an indication of the maximum available capacity on the maximum capacity path. 
A path description is a sequence of hops, which uniquely defines a path through a network. 

One of the tasks performed by the capacity manager 206 is the determination of an 
estimate of the capacity requirement of a given tunnel. If the estimated total capacity 
requirement is greater than the reserved capacity for the given tunnel, the capacity manager 
206 may determine that capacity of the given tunnel should be increased. To avoid frequent 
changes to the reserved capacity, the capacity manager 206 preferably acts to increase the 
reserved capacity to a value greater than the estimated total capacity requirement. If the 
estimated total capacity requirement is less than the reserved capacity, the capacity manager 
206 may make a determination that the reserved capacity should be decreased. To avoid 
frequent changes to the reserved capacity, the capacity manager 206 preferably makes the 
determination only if the estimated total capacity requirement is significantly less than the 
reserved capacity. If the estimated total capacity requirement is less than the reserved 
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capacity, but not significantly less, the capacity manager 206 may determine that the reserved 
capacity should not be modified. The details of the method by which the capacity manager 
206 estimates a capacity requirement for a tunnel, the amount of capacity by which to change 
reserved capacity and the meaning of "significantly less" are provided hereinafter. 

5 Turning to FIG. 4, a method, carried out at the capacity manager 206, for adapting the 

reserved capacity of a tunnel to requirements of incoming traffic begins with receipt of an 
indication of traffic demand on a given tunnel (step 402). The capacity manager 206 uses the 
received indication of traffic demand to determine an estimated total capacity requirement 
(step 404). The estimated total capacity requirement is then compared to the reserved 

1 0 capacity for the given tunnel (step 406). If the reserved capacity is greater than the estimated 
total capacity requirement, it is further determined whether the difference is significant (step 
410), and, if so, the amount of reserved capacity is reduced (step 414). If the reserved 
capacity is less than the estimated total capacity requirement, an attempt is made to increase 
the capacity of the given tunnel (step 408). The dynamism of the system 202 is related to a 

1 5 rate at which indications of traffic demand are received by the capacity manager 206. If the 
indications are received frequently enough, the system 202 may act in a near-real time mode, 
decreasing or increasing tunnel capacity almost as soon as traffic demand changes. 

When the capacity manager 206 determines that the reserved capacity for a given 
tunnel should be decreased to an estimated total capacity requirement (step 414), the capacity 
20 manager 206 indicates the value of the estimated total capacity requirement to the tunnel 

signaler 210. The tunnel signaler 210 sends messages to all the nodes 102 along the path of 
given tunnel reserving the new, smaller amount of capacity. 

Each change made in the reserved capacity for a given tunnel, i.e. either an increase 
(step 408) or a decrease (step 414), has consequences throughout the network 100. For 
25 instance, as a result of an increase in the reserved capacity for a tunnel between the edge node 
102A and the edge node 102C, the edge node 102C may select a different path for a tunnel to 
the edge node 102B than would have been selected before the increase. 
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The first step in attempting to increase the capacity of the given tunnel, refer to FIG. 
5, is to determine whether the current path for the given tunnel has sufficient available 
capacity so that the capacity of the given tunnel can be increased to the estimated total 
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capacity requirement (step 502). To determine whether the current path has available capacity 
to accommodate the estimated total capacity requirement, the capacity manager 206 indicates 
the value of the estimated total capacity requirement to the tunnel signaler 210. The tunnel 
signaler 210 sends messages to all the nodes 102 along the current path of the given tunnel 
requesting the estimated total capacity requirement. If all the links in the path have available 
capacity, i.e. capacity not reserved by other tunnels, to accommodate the increase, each node 
replies to the tunnel signaler 210 indicating a reservation of the estimated total capacity 
requirement for the given tunnel. The increased capacity may then be reserved for the given 
tunnel (step 504). If any links on the path do not have available capacity to accommodate the 
increase, the amount of available capacity on these limiting links (called bottleneck links) is 
returned to the tunnel signaler 210 and the capacity increase request is considered to have 
been refused. 

If the increase request is refused, the tunnel signaler 210 indicates the refusal to the 
capacity manager 206, identifies the bottleneck links and indicates the amount of available 
capacity on the bottleneck links. Upon receiving such a refusal, the capacity manager 206 
sends a request to the path selector 208 (step 506) to find an alternative path for the given 
tunnel. In the request to the path selector 208, the capacity manager 206 provides an 
indication of the current path of the given tunnel, the current value of the reserved capacity 
for the given tunnel and the value of the estimated total capacity requirement. The path 
selector 208 returns a path through a network having an available capacity not less than the 
estimated requirement. If such a path does not exist, the path selector 208 returns the path 
through the network having the greatest available capacity. 

Once the capacity manager 206 has received, from the path selector 208, an alternate 
path for the given tunnel, and the available capacity along the alternate path, the capacity 
manager 206 may determine whether the available capacity of the alternate path is sufficient 
to accommodate the estimated total capacity requirement (step 508). 

If the alternate path has sufficient capacity, the capacity manager 206 acts to move the 
given tunnel to the alternate path (step 510). Movement of an existing tunnel to an alternate 
path first requires that the capacity manager 206 request that the tunnel signaler 210 reserve 
capacity along the alternate path. 
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If the alternate path has insufficient capacity to accommodate the estimated total 
capacity requirement, the capacity manager 206 may act to negotiate an increase in the 
capacity of the bottleneck link on the current path of the tunnel (step 512). 

A method related to the negotiation of an increase in the capacity of a bottleneck link 
5 (step 512, FIG. 5) is illustrated in FIG. 6. If there is a tunnel-based layer providing network 
links 104 within network 100, the capacity manager 206 may send a request to the lower 
layer for an increase of the capacity of the bottleneck links (step 602). To request such an 
increase, the capacity manager 206 specifies the source and destination nodes of a given 
bottleneck link and an amount of the desired capacity increase. The request is received by an 

10 admission controller at a source node of a tunnel, in the lower layer, corresponding to the 
given bottleneck link. The admission controller at the source node treats such a request as a 
request for service, with a specification of required capacity, and proceeds as aforedescribed 
in relation to admission control. That is, if the admission controller in the lower layer 
determines that sufficient capacity is available, the request may be accepted. If the admission 

1 5 controller determines that sufficient capacity is not available, the request may be rejected or 
the amount of available capacity may be reported back to the capacity manager 206 so that a 
capacity increase may be negotiated. 

If the admission controller in the lower layer accepts the request, as determined in 
step 604, the capacity of the given bottleneck link is considered to have been increased and 
20 an equivalent increase in the capacity of the rest of the links in the path of the given tunnel 
may then be reserved (step 606). 

If the admission controller in the lower layer fails to accept the request, but instead 
offers to negotiate (i.e. if the admission controller in the lower layer can increase the capacity 
of the bottleneck link associated tunnel by less than the requested amount), the capacity 

25 manager 206 may compare the value of the total capacity available on the bottleneck link, as 
returned by the admission controller in the lower layer, to the value of the available capacity 
on the alternate path returned by the path selector 208 (step 608). If the value of the total 
available capacity on the bottleneck link is greater than the value of the available capacity on 
the alternate path, the capacity of the given bottleneck link is considered to have been 

30 increased and an equivalent increase in the capacity of the rest of the links in the path of the 
given tunnel may then be reserved (step 610). Otherwise, the capacity manager 206 proceeds 
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as if the request was rejected and acts to move the given tunnel to the alternate path returned 
by the path selector (step 612). If the admission controller in the lower layer rejects the 
request, the available capacity on the bottleneck link is considered to be null for the purposes 
of step 608. The moving of the given tunnel is only necessary if the alternate path is different 
5 than the current path. 

As may be clear from the above, where the system 202 (FIG. 2) is employed by nodes 
at all levels of a given network, the management of capacity can be very fast and efficient 
when compared to capacity management that is independent at each level. 

Some networks may permit the establishment of a secondary tunnel between the same 
1 0 edge nodes of a network if the capacity of the given tunnel may not otherwise be increased to 
the level specified by the capacity manager 206. In such a network, it may be possible to have 
more than one tunnel accommodate service requests that would otherwise be accommodated 
by a single tunnel. Further, when the capacity of the given tunnel cannot be increased along 
the current path, the capacity manager 206 may determine whether there is a secondary 
15 tunnel to accommodate the same class of service. If such a secondary tunnel is present, the 
capacity manager 206 may request that the tunnel signaler 210 increase capacity of the given 
tunnel to the maximum available capacity on the current path. Next, the capacity manager 
206 may request that the tunnel signaler 210 increase the capacity of the secondary tunnel by 
the balance of the capacity increase requested for the first tunnel, or to the maximum capacity 
20 available on the secondary tunnel, whichever is less. 

If there is no other tunnel for that service class, the capacity manager 206 may attempt 
to move the given tunnel to another path. If the capacity manager 206 does not succeed in 
moving the given tunnel to another path, the capacity manager 206 may request that the 
tunnel signaler 210 increase the tunnel capacity along the current path to the maximum 
25 available capacity and, further, that the path selector 208 find an additional path for a 
secondary tunnel to accommodate the remainder of the requested capacity increase. 

Finally, the capacity manager 206 may request that the tunnel signaler 210 establish 
an additional tunnel along the additional path returned by the path selector 208 with the 
required amount of capacity, or the maximum available capacity on the path, whichever is 
30 less. However, the establishment of more than one tunnel is likely to be unnecessary in high 
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capacity networks, where single paths will satisfy most tunnel requirements for capacity. It 
may safely be assumed that in high capacity networks there will be no need to open more 
than one additional tunnel, i.e. requests that cannot be accommodated by a single tunnel are 
unlikely to require more than two tunnels. 

5 When the capacity manager 206 determines that a decrease in the reserved capacity 

for a given tunnel is required (step 414, FIG. 4), a determination is made as to whether a 
secondary tunnel exists for serving the same class of requests between the same source and 
destination. If so, the capacity manager 206 further determines whether the total capacity 
required by both tunnels is less than the reserved capacity for one of the tunnels. If so, all 
10 future requests may be served by the tunnel whose reserved capacity exceeds the total 
capacity required by both tunnels and the other tunnel may be torn down. 

Details of preferred algorithms for use by the capacity manager 206 when estimating 
the capacity required by a tunnel (step 404, FIG. 4), and when determining an amount by 
which to change the reserved capacity, follow. 

15 The admission controller 204, in order to fulfill its role, maintains a record of the 

capacity used by serviced requests and by new requests for service. The admission controller 
204 passes to the capacity manager 206 a parameter representing an estimate of the required 
capacity, b est , and a rejected capacity parameter, b n for each tunnel. The estimated required 
capacity parameter, b esh is based on capacity used by the serviced requests while the rejected 

20 capacity parameter, b r , indicates the total capacity of requests for service that were rejected 
during a capacity update interval. The parameter b r preferably also takes into account the 
difference between originally requested capacity and a capacity settled on through 
negotiations. 

The capacity required by a given request for service may be specified as part of the 
25 request, or calculated by the admission controller 204 from parameters provided by the 

request for service. Such parameter may include "mean rate", "peak rate" and "burst size". A 
conservative estimate of capacity requirement from these parameters is the peak rate 
indicated by a request. 

For a given tunnel, the capacity used by serviced requests can be estimated as 
30 proposed in R. Guerin, H. Ahmadi, M. Naghishineh, "Equivalent Capacity and its 
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Application to Bandwidth Allocation in High-Speed Networks", IEEE JSAC, vol. 9, no. 7, 
Sept. 1991, hereby incorporated herein by reference. The estimation of capacity required by 
serviced requests in this estimation proposal is based on an assumption that the capacity used 
by the serviced requests has a normal distribution. This assumption is well justified when the 
5 volume of the used capacity is high, which is the case in high-capacity networks. Where b c is 
a representative of instantaneous capacity used by serviced requests, the estimation makes 
use of average used capacity, m, and of the standard deviation, a, of the used capacity. The 
estimation, b est , of required capacity may be calculated as 

b est = m + o^/-21n(fl0-ln(27c) 

10 Equation 1 

where d is the probability that instantaneous capacity used by serviced requests, b c , will 
exceed b est . The value of d is specified as a parameter related to the quality of service and is 
typically very small, in the order of 10~ 8 to 10" 6 , so that the estimation of the used capacity is 
almost always adequate for the requirements of service requests. The second component of 

15 the sum in Equation 1 is a margin included to accommodate variability of the capacity of 
serviced requests. 

The capacity manager 206 may, upon receiving b est and b r , calculate an estimated total 
capacity requirement b tota i for the given tunnel from 

b total =t> est +b r . 

20 Equation 2 

Equation 2 illustrates the addition of the rejected capacity parameter b r to the estimation of 
required capacity b est . The parameter a is maintained as a standard deviation of the estimated 
total capacity requirement b tota i- This approximation of the standard deviation is justified as 
the rejected capacity is likely to be small relative to the used capacity in high-speed networks 

25 with adaptive capacity management. 

The capacity manager 206 compares the total estimated total capacity requirement 
bmai to the reserved capacity for the given tunnel b res . If b tota i exceeds b res by a significant 
amount, then the capacity manager 206 may determine that an increase to the reserved 
capacity for the given tunnel is required. Requesting that the new reserved capacity, b new , be 
30 set to btotai, i-e. only by as much as necessary to meet the current total capacity requirement, 
would be optimal for the utilization of the capacity by tunnels. However, this capacity 
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increasing strategy may result in frequent changes to the reserved capacity. Frequent changes 
increase messaging overhead by the tunnel signaler 210, which decreases the efficiency of the 
utilization of network capacity. To limit the frequency of the changes to the tunnel capacity, 
the capacity manager 206 may request that the reserved capacity of the given tunnel be 
5 increased to a value greater than b total- The given tunnel would then have more capacity than 
the estimated total capacity requirement, and would therefore be able to accommodate 
another increase in traffic volume without having to have the capacity increased further. 

A network administrator may specify a share of tunnel capacity,/ to declare as a 
buffer for absorbing changes to the incoming traffic. The larger the value of f, the lower the 
1 0 frequency will be of requests for capacity changes. If b tota i > b res , the capacity manager 206 
may determine that the reserved capacity for the given tunnel, b res , should be increased to 

b n ew = y^y • The amount of the buffer,/Zw, is not necessary to serve the observed traffic, 

but it is reserved in case the volume of traffic increases again in a short period of time. 
Although the buffer does not give a complete assurance that the reserved capacity for the 
1 5 given tunnel will need another increase after a short time, the buffer greatly reduces the 
likelihood of such an event. 

When a tunnel has too little capacity to serve its traffic, the capacity manager 206 may 
determine that an increase to the reserved capacity for the tunnel is required. Similarly, when 
a given tunnel has more than sufficient capacity, the capacity manager 206 may determine 

20 that a decrease to capacity of the given tunnel is required, so that other tunnels may claim the 
freed capacity. Again, to limit the frequency of changes to the reserved capacity, the capacity 
manager 206 does not request a decrease in the reserved capacity of the given tunnel as soon 
as btotai < bres, but when b to tai is much smaller than b res . The capacity manager 206 may 
consider a tunnel underutilized when the estimated total capacity requirement, b tota h falls 

25 below a low level, vb res , where the low level indicator, v (<1-/), is set by the network 

administrator. In such a case, the capacity manager 206 may request that the tunnel signaler 
210 reduce the reserved capacity for the given tunnel to {\-f)-b res , i.e. the buffer for traffic 
increase may be removed from the requested capacity, as the buffer is unnecessary for a 
lightly utilized tunnel. The network administrator may further decrease the frequency of 

30 capacity adjustments by imposing a minimum time between two consecutive capacity 
decreases. 
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At the path selector 208, there is a requirement for a method for selecting new paths 
(step 506, FIG. 5) at the request of the capacity manager 206. Note, however, that the 
decision as to whether a selected path is used for a tunnel is left to the capacity manager 206. 
If the present invention is applied to an existing network, it is preferable that the routing 
5 method of the existing network be used select new paths. If the present adaptive capacity 
management scheme is to be used in a new network, whichever routing method is chosen for 
the new network is preferably used by the path selector 208 to select new paths. The 
following provides two exemplary path selection methods, but as will be apparent to a person 
skilled in the art, it is not intended that the adaptive capacity management scheme be 
10 restricted to these path selection methods. 

A first path selection algorithm is of use in networks wherein the network nodes 
inform other nodes of the capacity availability of their links, i.e. the amount capacity not 
reserved by tunnels. Each node in such a network sends capacity availability information to 
all other nodes in the network. This sending of capacity availability information may occur 
1 5 with a predetermined periodicity, or after the available capacity on a particular link changes 
significantly, i.e. by more than a threshold value. In such a network, the path selector at each 
node has a record of the capacity available in the entire network. 

When the capacity manager 206 requests a path (step 506, FIG. 5), for a given 
existing tunnel, with available capacity of at least b tota u the path selector 208 may find such a 
20 path using the following algorithm. Initially, the path selector 208 may add the capacity 

currently reserved by the given tunnel, b res , to the available capacity, b a , on each link along a 
path currently used by the given tunnel. Both the value of b res and an indication of the current 
path are supplied to the path selector 208 by the capacity manager 206. The path selector 208 
then assigns a metric to each link in the network. The value of the metric assigned to each 

25 link is 1 + — if b a > b tot ai and infinity otherwise. The path selector 208 then determines the 

b a 

path through the network from the source of the current path with a smallest total metric. If 
the determined path has a finite total metric, it may be concluded that the determined path 
uses a minimum number of links and has sufficient available capacity for reservation for the 
given tunnel. If the determined path has an infinite metric, it may be concluded that a path 
30 with sufficient available capacity does not exist in the network. 
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One algorithm useful for determining a path with a smallest total metric was 
developed by Edsger Dijkstra in 1959. Dijkstra's algorithm is a well known method described 
in, for example, C. Papadimitriou, K. Steiglitz, (1982), Combinatorial Optimization: 
Algorithms and Complexity , Prentice-Hall, the contents of which are incorporated herein by 
5 reference. Using the algorithm, finding the shortest path (i.e., the path which minimises a 
metric) for travelling from a given vertex on a graph to every other vertex is possible. 
Dijkstra's algorithm takes, as its input, a graph with links, each weighted with a metric, and a 
given root vertex. In the case where the metric represents the cost of each link, the algorithm 
returns an indication of the least cost path from the root vertex to the particular vertex as well 
10 as the overall cost of the path. 

Where a path with sufficient available capacity does not exist, the path selector 208 
may use a modified version of an algorithm found in Z. Wang, J. Crowcroft, "Quality-of- 
Service Routing for Supporting Multimedia Applications", IEEE JSAC, vol.14, no. 7, Sept. 
1996 to find a path with maximum available capacity (i.e. bandwidth). If there is more than 
1 5 one path with the maximum bandwidth, the following algorithm selects the path which has 
fewest hops. 

Where s and d respectively denote the source and destination nodes of a given tunnel, 
each node, n, in the network may be assigned three parameters: available bandwidth B(ri) 
over a maximum bandwidth path from s; numbers of hops H{ri) in that maximum bandwidth 
20 path from s; and the node preceding node n, P(n), in that maximum bandwidth path from s. 
Initially, if there is a direct link from s to n with available bandwidth b(s, «)>0, then B(n) = 
bis, n), H{n) = 1 and P(n) = s. Otherwise, B(n) = 0, H s {n) = oo and P(n) = go. 

The algorithm is illustrated in FIG. 7. Initially, the source node, s, is labeled (step 
702). Subsequently, the unlabeled nodes are considered with regard to selecting a next node, 

25 rinexb having the greatest available bandwidth over a path from s, B{ri) (step 704). If there is 
more than one node having the greatest B(n), the node with the least H(n) is selected as next 
node, n„ext. Where more than one of the nodes having the greatest B(n) also have equivalent 
hop counts, one of these nodes is arbitrarily selected as next node, n next . The next node n next is 
then labeled (step 706). If it is determined (step 708) that the selected next node is also the 

30 destination node (i.e. n next = d),a path is considered to have been found and the found path 
may be indicated to the capacity manager 206 (step 710). The indicated path comprises the 
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destination, d, its predecessor, P(d), its predecessor's predecessor, P(P(d)), and so on tracing 
a path back to the source, s. If n next 7^ d, then the value of the parameters are processed (step 
712) for each unlabeled node, n, with a direct link to n next , i.e. for which b{n next , n)>0. 

The processing of parameters is illustrated in FIG. 8. Initially, an unlabeled node n, 
5 connected to the next node, is selected for consideration (step 802). If B{n) < mm[B(n next ), 
binnext, »)] (step 804), then5(n) is reassigned to min[ B(n next ), b(n next , n)] (step 806), the 
number of hops from the source is set such that H{ri) = H(n next ) + 1 (step 808) and the 
predecessor is set such that P(ri) = n next (step 810). If it is subsequently determined that there 
are nodes left to consider (step 812), the process begins again with the selection of another 

10 unlabeled node connected to the next node (step 802). Otherwise, the processing is complete. 
If B(n) > mm[B(n next ), b(n next , n)] (step 804), then it is further determined whether B(n) = 
mm[B(n next ), b(n next , »)] (step 814). In the case of an equality in step 814, the node under 
consideration has been reached via an old path and the hop count is examined (step 816) to 
determine whether the new path, through n nexh is more efficient than the old path (i.e. has 

1 5 fewer hops). If the new path has fewer hops, the hop count is set such that H(n) = H(n next ) + 1 
(step 808) and the predecessor is set such that P(n) = n next (step 810). If the old path is more 
efficient (step 816) or has greater bandwidth (step 814), then it is determined whether there 
are nodes left to consider (step 812). 

A second path selection algorithm applies to networks wherein a network 
20 administrator, or a network management system, provides each node with a routing table, 
listing paths to each destination in the network. The routing table need not cover all the 
possible paths. A few paths, say five, per origin/destination pair will suffice. Those lists can 
be updated after significant changes to the network topology, or link utilization. 

Upon receiving, from the capacity manager 206, a request for a path (step 506, FIG. 
25 5), path selector 208 may check paths other than the tunnel path in the routing table for 

capacity availability. The path selector 208 returns to the capacity manager 206 the first path 
which has sufficient available capacity. If none of the paths on the list has sufficient available 
capacity, the path selector 208 may return, to the capacity manager 206, the path with the 
greatest available capacity. 
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In review then, there are at least three benefits to the present invention. First, the 
dynamism of the proposed system. The system acts in a near-real time mode, based on 
measurements and information exchange within and between network nodes 102. Second, 
although the capacity manager 206 and the path selector 208 make decisions locally, the 
5 decisions are based on the network-wide information and the decisions have network-wide 
consequences, i.e. tunnels selected, or modified, by the decisions change bandwidth 
allocation in the network links. Third, the system may be applied to all levels of a network, 
allowing for very fast and efficient bandwidth management, as compared to individual and 
independent bandwidth management at each level. 

1 0 Other modifications will be apparent to those skilled in the art and, therefore, the 

invention is defined in the claims. 
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We claim: 



1 1 . A method for changing a reserved capacity for a given tunnel, comprising: 

2 receiving an indication of traffic demand for a tunnel through a network; 

3 based on said received indication, determining an estimated total capacity 

4 requirement; 

5 comparing said estimated total capacity requirement to said reserved capacity; and 

6 where said estimated total capacity requirement exceeds said reserved capacity, 

7 requesting an increase of said reserved capacity. 

1 2. The method of claim 1 further comprising, where said reserved capacity exceeds said 

2 estimated total capacity requirement, requesting a decrease to said reserved capacity. 

1 3. The method of claim 1 where said requesting further comprises: 

2 determining whether a current path of said tunnel has sufficient available capacity to 

3 accommodate said estimated total capacity requirement, said current path having a 

4 source node and a destination node; and 

5 where said current path of said tunnel has sufficient available capacity to 

6 accommodate said increase, transmitting signaling to nodes along said current path to 

7 request said increase of said reserved capacity. 

1 4. The method of claim 3 further comprising: 

2 where said current path of said tunnel has insufficient available capacity to 

3 accommodate said increase, 

4 determining a plurality of paths through said network from said source node to 

5 said destination node, where each path of said plurality of paths has an 

6 associated available capacity; and 

7 selecting one path of said plurality of paths having sufficient associated 

8 available capacity to accommodate said estimated total capacity requirement. 
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1 5. The method of claim 4 further comprising: 

2 transmitting signaling to nodes along said selected one path of said plurality of paths 

3 to request said estimated total capacity requirement; and 

4 moving said tunnel to said selected one of said plurality of paths. 

1 6. The method of claim 3 further comprising, where said current path of said tunnel has 

2 insufficient available capacity to accommodate said increase, 

3 determining a plurality of paths through said network from said source node to said 

4 destination node, where each path of said plurality of paths has an associated available 

5 capacity; 

6 where said estimated total capacity requirement exceeds said associated available 

7 capacity of each of said plurality of paths, 

8 determining a limiting link in said current path, where said limiting link has a 

9 minimum available capacity among links in said current path; and 

10 communicating with a lower level network to request an increase of available 

1 1 capacity on said limiting link. 

1 7. The method of claim 6 further comprising, 

2 where said request to said lower level network is accepted: 

3 transmitting signaling to nodes along said current path to request said increase 

4 of said reserved capacity to said estimated total capacity requirement. 

1 8. The method of claim 6 further comprising, 

2 where said lower level network returns an available capacity of said limiting link and 

3 where said estimated total capacity requirement exceeds said available capacity of 

4 said limiting link, 

5 selecting one path of said plurality of paths having a maximum associated available 

6 capacity among said plurality of paths; 
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7 where said available capacity of said limiting link exceeds said associated available 

8 capacity of said selected one path of said plurality of paths: 

9 transmitting signaling to nodes along said current path to request that said 

10 reserved capacity be increased to said available capacity of said limiting link. 

1 9. The method of claim 6 further comprising, 

2 where said lower level network returns an available capacity of said limiting link and 

3 where said estimated total capacity requirement exceeds said available capacity of 

4 said limiting link, 

5 selecting one path of said plurality of paths having a maximum associated 

6 available capacity among said plurality of paths; 

7 where said available capacity associated with said selected one path of said plurality 

8 of paths exceeds said available capacity of said limiting link: 

9 transmitting signaling to nodes along said selected one of said plurality of 

1 0 paths to request said estimated total capacity requirement; and 

1 1 moving said tunnel to said selected one of said plurality of paths. 

1 10. The method of claim 6 further comprising, 

2 where said request to said lower level network is rejected: 

3 selecting one path of said plurality of paths having a maximum associated 

4 available capacity among said plurality of paths; 

5 transmitting signaling to nodes along said selected one of said plurality of 

6 paths to request said associated available capacity; and 

7 moving said tunnel to said selected one of said plurality of paths. 

1 11. The method of claim 1 wherein said receiving said indication of traffic demand 

2 comprises: 

3 receiving an indication of tunnel capacity in use by serviced requests; and 
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4 receiving an indication of tunnel capacity refused admission to the tunnel. 

1 12. The method of claim 1 wherein said increase of said reserved capacity comprises a 

2 difference between said reserved capacity and said estimated total capacity requirement. 

1 13. The method of claim 1 wherein said increase of said reserved capacity comprises a 

2 difference between said reserved capacity and a sum of said estimated total capacity 

3 requirement and a buffer value. 

1 14. A method of selecting a path from a source node to a destination node comprising: 

2 labeling said source node; 

3 assigning a value to a reported bandwidth associated with each of a plurality of 

4 unlabeled nodes where: 

5 if an unlabeled node has a link from said source node, said reported bandwidth 

6 is assigned a value based on a bandwidth of said link from said source node, 

7 otherwise said reported bandwidth is assigned a value of zero; 

8 until said destination node is labeled, 

9 selecting a next node, among said plurality of unlabeled nodes, having a 

10 maximum reported bandwidth value; 

1 1 labeling said next node; 

1 2 processing nodes connected to said next node to reassign corresponding 

13 reported bandwidth values; and 

14 where said next node is said destination node, selecting a path from said source node 

1 5 to said destination node corresponding to said maximum reported bandwidth value 

1 6 associated with said next node. 

1 1 5. An apparatus for changing a reserved capacity for a given tunnel, comprising: 

2 means for receiving an indication of traffic demand for a tunnel through a network; 
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3 means for determining an estimated total capacity requirement based on said 

4 indication; 

5 means for comparing said estimated total capacity requirement to said reserved 

6 capacity; and 

7 means for requesting an increase of said reserved capacity. 

1 1 6. A computer readable medium for providing program control for a node in a network, said 

2 computer readable medium adapting said node to be operable to: 

3 receive an indication of traffic demand for a tunnel through said network; 

4 determine an estimated total capacity requirement based on said received indication; 

5 compare said estimated total capacity requirement to a reserved capacity for said 

6 runnel; and 

7 where said estimated total capacity requirement exceeds said reserved capacity, 

8 request an increase of said reserved capacity. 

1 1 7. A processor, in a node in a network, operable to: 

2 receive an indication of traffic demand for a tunnel through said network; 

3 determine an estimated total capacity requirement based on said received indication; 

4 compare said estimated total capacity requirement to a reserved capacity for said 

5 tunnel; and 

6 where said estimated total capacity requirement exceeds said reserved capacity, 

7 request an increase of said reserved capacity. 

1 1 8. A system for automated adjustment of a reserved capacity for a tunnel through a network 

2 comprising: 

3 a tunnel signaler; 

4 an admission controller; 
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5 a path selector, 

6 a capacity manager operable to : 

7 receive, from said admission controller, an indication of traffic demand for 

8 said tunnel; 

9 determine an estimated total capacity requirement based on said received 

10 indication; 

1 1 compare said estimated total capacity requirement to said reserved capacity; 

12 and 

13 where said estimated total capacity requirement exceeds said reserved 

14 capacity, communicate with said tunnel signaler to request an increase of said 

15 reserved capacity. 

1 1 9. A data structure for use in communicating information regarding traffic demand for a 

2 tunnel comprising: 

3 an indication of tunnel capacity in use; and 

4 an indication of total capacity refused admission to said tunnel. 
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ABSTRACT 

Management of the bandwidth capacity of tunnels through a network may be 
automated such that the network is adaptive to the stochastic nature of incoming traffic. An 
edge node in the network includes four main elements. Three of the elements, namely tunnel 
signaling, admission control and path selection, are derived from known technologies, 
generalized from their particular technologies and enhanced. With the addition of a fourth 
element, called capacity management, the four elements cooperate to accommodate the 
capacity needs of the traffic incoming to the network at the edge node. This accommodation 
is performed by estimating the traffic demand and dynamically adapting tunnels to the traffic 
demand. 
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PLEASE SEND CORRESPONDENCE TO : SMART & BIGGAR 

438 University Avenue 
Suite 1500, Box 111 
Toronto, Ontario 
M5G 2K8 CANADA 

Attention: Ronald D. Faggetter 

Telephone: (416) 593-5514 
Facsimile: (416) 591-1690 



1) INVENTOR'S SIGNATURE:. 




Inventor's Name: Tadeusz L Drwiega 

(First) (Middle Initial) (Family Name) 

Country of Citizenship: Canada . 

Residence: Kanata, Ontario, Canada 

(City, Province, Country) 

Post Office Address: 64 Mcintosh Place. Kanata. Ontario. Canada. K2L 2N8 



2) INVENTOR'S SIGNATURE:. 




Inventor's Name: James L Yan 

(First) (Middle Initial) (Family Name) 

Country of Citizenship: Canada . 

Residence: Nepean, Ontario, Canada 

(City, Province, Country) 

Post Office Address: 7 Scova Crescent, Nepean, Ontario, Canada. K2J 1K2 



91436-255 (Case 11998ROUS01U) 
CCC/kek 



